Energy-Optimal Scheduling in Low Duty Cycle Sensor Networks 



Nursen Aydin, Mehmet Karaca and Ozgur Ercetin 
Faculty of Engineering and Natural Sciences, Sabanci University, Istanbul, Turkey 
{nursenaydin,mehmetkrc,oercetin}@ sabanciuniv.edu 



o 



(N 
> 

rn 

rn 
O 



X 



Abstract — Energy consumption of a wireless sensor node 
mainly depends on the amount of time the node spends in 
each of the high power active (e.g., transmit, receive) and low 
power sleep modes. It has been well established that in order to 
prolong node's lifetime the duty-cycle of the node should be low. 
However, low power sleep modes usually have low current draw 
but high energy cost while switching to the active mode with a 
higher current draw. In this work, we investigate a MaxWeight- 
like opportunistic sleep-active scheduling algorithm that takes 
into account time- varying channel and traffic conditions. We 
show that our algorithm is energy optimal in the sense that the 
proposed ESS algorithm can achieve an energy consumption 
which is arbitrarily close to the global minimum solution. 
Simulation studies are provided to confirm the theoretical 
results. 

Keywords -Energy model, Sleep scheduling, Lyapunov Opti- 
mization, Sensor networks. 

I. Introduction 

Wireless sensor network consists of many battery operated 
nodes with limited processing and wireless communicating 
abilities. They are used in many different areas such as 
military, scientific research or medical diagnostics. Since 
sensor networks are uniquely identified by their requirement 
of operation for a long period without outside intervention, 
energy consumption is a primary concern. Unnecessary en- 
ergy consumption can be caused from the implementation at 
PHY layer For instance, keeping the sensor nodes in active 
all the time is one of the main inefficiency. Furthermore, 
energy unaware scheduling algorithms employed at MAC 
or above layers is the another reason for the unnecessary 
energy consumption. 

A particularly important strategy is to minimize wasted 
energy due to idle listening, in other words, operate the 
nodes with low duty cycles yj. Duty cycle is defined as 
the proportion of time the node stays active in its lifetime. 
Thus, it is necessary to reduce the duty cycle in order to 
resolve this conflict. A sensor node consumes energy while 
transmitting, receiving and sleeping Also, switching between 
these three modes is the another issue and the sensors require 
extra time and spend extra energy for switching. In most 
prior works, it was assumed that the switching energy is 
negligible compared to the energy spent in other modes. 
It is recently observed that, this assumption does not hold 
in low duty cycle sensor networks IJ). For example, in ||2] 
for CClOlO type sensor nodes, while the switching energy 
from sleep mode to transmit mode is given as 47.75 jjJ for 



the switching time is 0.7 ms, the energy consumed during 
the transmission taken 0.7 ms is equal to 124.8/iJ. This 
measurement shows that the switching energy is crucial 
and should be taken into account for any energy efficient 
scheduling algorithm. 

In the literature, there are many scheduling algorithms 
that have been developed for network stability problem 
with strong theoretical results. Tassiulas et al. in f3l first 
introduced the design of backpressure algorithms based on 
Lyapunov drift techniques to achieve network stability and 
the authors in ||4] developed algorithm which deals with 
performance optimization and queue stability problems si- 
multaneously in a unified framework. There exists also a rich 
literature on using Lyapunov drift optimization for solving 
problems of energy optimization in wireless networks. In 
this paper, one of our objectives is to show the significance 
of switching energy in the design of scheduling policy. 

II. Related Works 

There are many works that offer low energy consumption 
in the Uterature ||5], ||6l, Q, H). In all these works, the 
proposed algorithms and experiments have been designed 
by only taking into account the energy consumption in 
the active and sleep modes but they have not considered 
the consumed energy during switching from one state to 
another In addition, none of these works deals with the 
network stability problem with the objective of minimum 
energy. In ||9l, the authors have proposed wireless sensor 
network protocols that take into account the source of energy 
consumptions in a network simulation model. They have also 
mentioned about switching energy but leaved it as an open 
research area. The study in |[T0) have considered switching 
energy cost since it has been observed that significant energy 
consumption occurs when switching from sleep mode to the 
active mode. On the other hand, in some studies like ifTTl it 
has been stated that the energy cost of switching is small. 
Generally, it is common to ignore switching energy in the 
literature. There are also various approaches proposed for 
designing duty cycling protocols lfT2l . |]2l, lfT3l . for sleep 
mode protocols lfT4l and for routing protocols llTSl . llT6l . All 
of these works try to maximize the lifespan or the utility 
of the network without considering the network stability 
problem. 

The works in ITTl . IfTSl and |fT9l are the most important 
ones considering network stabiUty issue for wireless sensor 



network. In ifTTl . the authors proposed a back pressure al- 
gorithm designed using a Lyapunov drift based optimization 
framework using the receiver capacity model. However, they 
did not aim to minimize the average energy consumption. An 
optimal control algorithm for rechargeable wireless sensor 
nodes is proposed in tlSj where the objective function is 
maximize the network utihty subject to stability. In |fT9l . the 
authors proposed a scheduling algorithm based on Lyapunov 
optimization theory in order to minimized the consumed 
energy while maintaining the network stability. However, 
they do not consider low duty cycle sensor networks. 

In this paper, we develop a throughput optimal scheduling 
algorithm based on the Lyapunov drift framework which 
considers not only minimizing energy but also sustaining 
network stability for low duty cycle sensor networks. Our 
energy switching and scheduling (ESS) algorithm is energy 
optimal in the sense that it minimizes the overall expected 
energy consumed in the network over all scheduling algo- 
rithms and remains throughput optimal. The proposed ESS 
algorithm prolongs the lifetime compared to the benchmark 
algorithm which does not consider switching energy. There- 
fore, our proposed ESS algorithm is more favorable for 
scheduling in low duty cycle wireless sensor networks. 

The rest of the paper is organized as follows. Section 
III describes the system model and problem formulation. 
The proposed ESS algorithm is introduced in Section IV. 
Lyapunov optimization technique which is used to show 
the performance and the optimality of ESS algorithm and a 
distributed algorithm are given in Section V. We present our 
simulation result in Section VI and Section VII concludes 
this paper. 

III. System Model and Problem Statement 
A. System Model 

We consider an uplink scenario where N sensor nodes 
sense the environment and transmit to a base station. The 
network is operated in slotted time t = 0, 1, 2, ... where slot t 
corresponds to the time interval [t,t+l). The node channels 
are time-varying and the instantaneous channel state is repre- 
sented by M(t) and assume it is i.i.d distributed over a finite 
set M, M{t) e M. We also define 7r,„ ^ Pr(M(t) = m) 
as steady state probability of being in channel state m at time 
slot t. Channels are assumed to hold their state within one 
time slot. The data rate of node n during slot t is represented 
by /i„(/„(t), Mn{t)) (in units of packets/slot) where M„(t) 
is the channel state of node n and /„(t) = 1, whenever 
node n is selected as a transmitting node at time t, and 
In{t) = Otherwise. We assume that /i„(/„(f;), A/„(t)) is 
upper bounded with ^n{In{t), Mn{t)) < ^max- For ease of 
notation, we use instead of /i„(/„(t), Af„(i)) in the 

rest of the paper 

At each time slot t, the number of new packets generated 
by node n is denoted by i?„(t). We assume that i?„(t) is 
i.i.d for each time slot with an average rate of A„, and it is 



upper bounded with i?„(i) < Rmax- We define the network 
admission rate vector as A = {Ai, A2, Aat} where A„ is 
the average exogenous arrival rate of node n. Let A be the 
network capacity region, i.e., the set of all feasible admission 
rate vectors that the network can support. 

B. Notations 

In our network model, there are K the sensor nodes which 
can be in active or sleep modes at a particular time slot. 
Therefore, the node n G N where N represents the set of 
all nodes has an action space denoted as A = {0,1}. We 
denote s as the action taken by any node and s — and 
5 = 1 represent the sleep and active modes respectively. 
The sensor can also switch from active to sleep or vice versa 
and we denote sw G {01, 10} as the switching action where 
sw = 01 and sw = 10 represent the switching from sleep 
to active and active to sleep modes respectively. In addition, 
we denote the set of all sleep and active nodes as SI and 
Ac respectively at a given time slot. 

C. Problem Formulation 

We begin with a definition of network stability. Let Qn{t) 
be the queue backlog of node n at time slot t. 
Definition 1: A queue is strongly stable if 

1 

limsup-^E(Q„(t)) < 00 (1) 

Moreover, if every queue in the network is stable then the 
network is called stable. The system stability region is the 
the closure of the convex hull of all arrival rate points for 
which there exists a feasible scheduling policy that achieves 
system stability H. 

We consider an energy consumption model defined as 
follows. At the beginning of transmission, each sensor has a 
full battery of E. In each time slot, a particular node can be 
either in active or sleep modes according to its remaining 
energy, queue backlog and channel condition. During the 
sleep mode, the node is unable to transmit packets. However, 
packets continue to be generated by the node, and they are 
queued until the node has the opportunity to transmit them. 
Let e"(t) be the energy consumed by node n when it is 
in mode s G {0, 1} at time t. When the node is active, 
it consumes an energy c„(t) that depends on the current 
draw of active mode by the circuit, and how much time the 
node spends in active mode. Also, the energy needed for 
packets transmission should be included to the total energy 
expenditure when the node is selected to transmit. Then at 
time t, the total energy consumption by node n in active 
mode becomes e"(t) = c„(t) + fin{t)an where denotes 
the energy spent for a packet transmission. Furthermore, if a 
node switches from sleep-to-active or active-to-sleep modes, 
then the switching energy denoted as e^^{t) is consumed. 
The values of energy costs are given in Section VI. Hence, 



the overall energy spent by node n during time slot t is given 
by: 



i?"(t) = ^e^(0 + e^^(0 se{0,l}. 



(2) 



and the total energy consumption in the network at time slot 
t is obtained by summing over all nodes in the system, 

^w = EE^"w + E^-w ^e{o,i} (3) 

n sEA n 

Define the time average expected total energy consumption 
as. 
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H = lim sup - E 

r— 



(4) 



The expectation is with respect to the randomness that arises 
from channel variations and arrival process and possibly 
from random stationary switching policy. The overall energy 
consumption during time t is upper bounded by a finite 
value since all sensors have a limited battery power and thus, 
without lost of generality, we assume that the following is 
satisfied at every time slot. 



(5) 



We are interested in minimizing the total average energy 
consumption in the network while keeping the queue sizes of 
the sensor nodes bounded. Then, our optimization problem 
can be formalized as follows. 



min H 

s.t. network stability. 



(6) 
(7) 



IV. Energy-Aware Switching and Scheduling 
(ESS) Algorithm 

In this section, we introduce our energy aware sleep-active 
scheduling algorithm which asymptotically minimizes the 
average network energy consumption subject to the network 
stability. Furthermore, the proposed algorithm is shown to be 
throughput optimal meaning that the algorithm can guarantee 
the network stability for all feasible network admission rates. 

At each time slot, the proposed Energy-aware Switching 
and Scheduling (ESS) algorithm determines the energy 
modes of operation for each sensor nodes and selects the 
transmitting node which maximizes the following: 
ESS 



max 

n^Ac.s 



Qn{t)tln{t)-Vs^^{t) 



{t). (8) 



In (O, 1/^ > is a system parameter and shows the well- 
known delay-energy tradeoff Q. For very large value of V 
we can push the average energy consumed by ESS algorithm 
arbitrarily close to the global minimum energy. However, in 
that case in order to maximize (|8) nodes stay in the sleep 



mode most of the time, and consequently, the queue sizes 
increase. 

Remark 7: As it is seen in dHJ, ESS algorithm is different 
from the Max Weight algorithm, and the algorithm proposed 
in (191 since ESS not only considers the energy consumption 
in sleep and active modes but also takes into account the 
switching energy cost. It is shown in simulation studies that 
this cost cannot be ignored and has significant in the life 
time of the network. 

Remark 2: The basic properties of ESS algorithm are as 
follows. In each time slot t at most one node is active, and 
this node transmits. The active node continues to transmit 
in consecutive slots until some other node is the maximizer 
of dHJ. On the other hand, the rest of the nodes stay in 
the sleep mode and their queue backlogs increase. Once 
the queue backlog of a sleeping node is sufficiently high in 
order to maximizes (|8) then this node is selected to transmit. 
Furthermore, if all of the queue backlogs are low, the nodes 
choose to stay in the sleep mode. Thus, the system can be 
in the idle state where no nodes choose to be active during 
some of the time slots. 

Lemma 1: ESS satisfies the following properties. 

1) Sensor nodes transmit in a bursty fashion, i.e., transmit 
multiple packets once they capture the channel. 

2) The system operation is non-work conserving, i.e., 
there are idle slots when no sensor node transmits even 
if their backlog is non-empty. 

Proof: For notational brevity, let n and m represent the 
active and sleeping nodes respectively and their correspond- 
ing queue sizes are denoted as Qn{t) and Qm{t) at time slot 
t. If the active node n prefers to be again active during next 
time slot t + 1, it does not need to change its energy mode 
and there will be no switching energy cost ie^^{t) = 0). 
Thus, its weight is equal to Qn{i)lJ-n{t) — Ve'^{t) according 
to (O. On the other hand, if it switches its mode from active 
to the sleep, then it obtains the weight which is equal to 
—Ve'l^{t) — Ve'^i{t) since it cannot transmit in sleeping mode 
and = and also it pays a switching energy cost 

which is equal to e"g(t) > 0. Therefore, the node n prefers 
to stay in active mode if and only if the weight obtained in 
active mode exceeds the weight resulting from switching to 
sleep mode. In other words, the following inequality should 
be hold. 



Thus 



< Quit) 



(9) 



Furthermore, since ESS algorithm aims to maximize (|8), the 
node n continues to be active and transmits if and only if it 



is the maximizer of ([8]l. 



<Qn{t)Mt)-Ve'^{t) 

Therefore, as long as inequahties (|9) and (fTOl i hold, active 
sensor node transmits in a bursty fashion and the other nodes 
do not change their energy modes. This completes the first 
part of Lemma 1 . 

On the other hand, if the sleeping node m prefers to stay 
in sleep mode during next slot t+1, according to equation ([SJ 
its weight is —Ve^{t) since it cannot transmit then i-i,n{t) = 
and there will no switching cost e"^ (t) = 0. If it switches 
to active mode and transmit, then it obtains the weight which 
is equal to Q.,n{t)lJir,i{t) - Vel\{t) - Ve'^it). Therefore, the 
node m node continues to stay in sleep mode if and only 
if its queue sizes is not large enough to cover the reward 
being in sleep mode. In other words, it stays in sleep mode 
as long as the following inequality holds. 



Thus 



V{eT{t)+eZ{t)-e'-{t)) 



> Qrnit) 



randomized function of only the data rates and it is inde- 
pendent of the queue backlog. Let us denote the stationary 
randomized algorithm as RND. With RND algorithm, the 

(10) switching decision is determined by a Markovian process 
with two states; sleep and active. We denote the transition 
probabilities from active to sleep states and from sleep to 
active states as pio and poi respectively. The steady-state 
probabilities of the active and sleep modes are denoted as 
tTq and tt^ respectively. We assume that channel processes 
are ergodic with steady-state probabilities tt^ where k is 
describing the channel state in a finite set, k 6 {1,2,...,M}. 
The following theorem specifies the minimum energy re- 
quired for stability, among the class of stationary policies 
that randomly decides on sleep-active modes and transmit 
scheduling. 

Theorem 1: If arrival rate vector is strictly in the capacity 
region A G A, then the minimum energy that can stabilize 
the network is denoted by h* and it is equal to the solution of 
the following optimization problem that is defined in terms 
of transition probabilities {p2j)k for G {0, 1}, steady- 
state probabilities (7r")fc for I G {a, s} and transmission 
probabilities (TrJJ,)^ at channel state k G M. 

(11) min ^^Y^iPiMOk + boi)fc«)fceL + iOke^, 



Similarly, the active node prefers to switch to sleep mode, if 
its backlog is not large enough to maximize Therefore, 
the system is idle if the following inequalities are satisfied 



Qn{t) < 



Vn G Ac (12) 



nerW+eSUO-CW) ,13, 



V. Throughput optimality of ESS 

Despite the fact that ©-(V) is a convex optimization prob- 
lem, a direct solution is generally overly complicated since 
the arrival rates resulting network stability does not admit 
in general a simple characterization. Fortunately, we can 
use the framework of [4|, and obtain a dynamic scheduling 
policy that operates arbitrarily closely to the optimal point. 
This is obtained in two steps: first, a dynamic scheduling 
policy that achieves the stability of transmission queues 
whenever the arrival rates are inside the stable network 
operating region is obtained. Second, we define a stationary 
randomized algorithm and compare the randomized policy 
with our ESS algorithm. 

A. Optimal Stationary Randomized Algorithm 

Now, we present a stationary randomized algorithm which 
is used to prove the stabiUty property and throughput 
optimality of ESS algorithm. The randomized algorithm 
schedules the nodes according to a stationary, and possibly 



fceM n 



+ (7r,")fc(c"(0 + (7rr.).(/.„).a„) 

S.t. ^ TTk{TTa)k{Kr)k{l^n)k > K Vn 



fceM 

EK)^^1 VpG{a,s}, Vn 

k 

Kr)k < 1 Vfc 

n£Ac 

where {fJ,n)k is the data rate of node n at channel state 
fc G M. 

Proof: The proof follows the same line of logic as the 
proof given jSOj . The optimization problem above can be 
solved since the set of channel state is finite and the energy 
set is compact. Thus, we can achieve the minimum energy 
by a randomized algorithm which decides the switching de- 
cision with probabilities (p^ )fc and selects the transmission 
node with probability (ttJJ.)/;. 

Since A lies in the interior of the network capacity region 
A, it follows that there exists a small positive e > such 
that A + e G A. Then, there exist a stationary policy which 
stabilizes the network while providing a data rate of 



E(/i(t)) > A + e, 



(14) 



where ft is the transmission rate induced by the randomized 
policy. Let h*{e) be the minimum energy consumed by such 
policy. Since expected transmission rate is greater than the 
arrival rate, the network is stable. In addition, since h* (e) is 
the minimum energy required to stabilize the network with 



arrival rate A+e, any mixed strategy results in higher energy 
consumption. Therefore, it is obvious that 

h*<h*{e)<(l-^)h* + ^h*{e^ax) (15) 

where emax is the largest scalar where Xn+£max G A. When 
e = ^max, nodes consume much more energy to stabilize 
the queues. Therefore, h*{emax) > Ve. It follows that 

h*{e) /i* as e ^ 0. 

■ 

Theorem 1 indicates that the minimum energy consump- 
tion for stability is achieved among the class of stationary 
policies that measure the current channel state M(t), and 
then randomly decides switching and selects the user which 
transmits. 

B. Analysis of ESS 

In our work, we use Lyapunov drift and optimization 
tools im to show the optimality of ESS algorithm. The 
advantage of this tool is the ability to deal with performance 
optimization, and queue stability problems simultaneously 
in a unified framework. For node n the queue dynamics is 
given by 

Q„{t + 1) = max(Q„(t) - At„(t),0) + i?„(i) (16) 

We can write the following inequality by using the fact 

([a] + )2 < Va: 

Ql{t + l)<Ql{t) (17) 

max Y ~ 2Q„{t)[fin{t) - Rn{t)] 

Let Q{t) = {Qi{t), Q2{t), QN{t)) be a queue vector and 
define the following quadratic Lyapunov function 



1 ^ 



ri=l 



and the conditional Lyapunov drift is 

A{t) ^ E {L{Q{t + 1)) - L{Q{t))\Q{t)} (19) 

Then, by using (17) Lyapunov drift of the system satisfies 
the following inequality at every time slot, 

A{t) < B - Y,^{Qn{t){Mt) - RnimQm , (20) 



where 



K , 

B — —{{^J.max)'' + {Rmax) )■ 



(21) 



adding the cost function multiplied by V to both sides of 
(|20] |. we have the following. 

A{t) + vnH{t)\ci{t)) 

< B -Y,^{Qn{t){pn{t) - Rn{t))\Cl{t)} + T/E(i/(t ) | Q (t ) ) 

n 

<B-Y,^ {Qn{t)^in{m{t)] + ^ E E ^ {e: wiQ w} 

n n s 

+ FEE{eLWIQW} 

n 

^ B - E^ - ^'^-W - v-EesWIQwj 

^ V ' 

(22) 

where RHS^^^ is the right hand side of (|22li. It is 
now straightforward to see that ESS algorithm minimizes 
RHS^^^ over all possible stationary algorithms. 

We now present a fact given in [4| that will be used to 
prove that ESS is throughput optimal. 

Theorem 2: (Lyapunov Stability) For scalar valued func- 
tion g{.) for which the minimum value is equal to g*. If there 
exists positive constants V,e,B such that for all time slots 
t and all backlog vectors Q{t), the Lyapunov drift satisfies 

N 

A{t) + VE{g{t)\Q{t)) <B- eY,Q.{t) + Vg\ (23) 

i=l 

then the system is stable and the time average backlog 
satisfies: 

1 ^ B + V * 

i™™p T E EiE{^?»w} ^ 



t=0 i=l 

Theorem 3: The proposed ESS algorithm is throughput 
optimal. 

Proof: Clearly, the RHS of the randomized policy RND 
is given as follows 



(18) = 5 - E ^ {g„ w(An(i) - i?„(i))iQ(t)} 



In addition, we define a cost function E{H{t)\Q{t)) as the 
expected total energy consumption during time slot t. After 



(24) 

where /i„(t) is the transmission rate achieved by RND at 
time slot t. By using ( fT4] i and adding the cost function, we 
have 

B - eY^Q„{t)+VE{H,{t)\Q{t)) 

n 

<B-eY,Qnit) + VH,^ax (25) 

n 

where He{t) is the actual energy consumption of the ran- 
domized policy during time slot t and it depends on e. By 
definition, i?i7S'^^^ < RHS^^^. Then, we obtain 

^^^BSS < EHS'^^'' <B-eY^Qn{t) + VH„,ax 

n 

(26) 



Thus 

A{t) + VE{H{t)\Q{t)) <B-eY,Qn{i) + VH„,a. 

n 

(27) 

It is straightforward to see that (l2Tt has exactly same form 
as ( |23] |. Thus, this proves the theorem. ■ 

C. Optimality of ESS 

In this section, we show that ESS algorithm yields asymp- 
totically optimal solution to (6)-(7). In other words, the 
average energy consumption proposed by the ESS algorithm 
can be made arbitrarily close to the global minimum solution 
of (6)-(7), by selecting a sufficiently large value of a real- 
valued constant V. The following fact from ID establishes 
a bound on any scalar-valued function g{.). 

Theorem 4: (Lyapunov Optimization) If ( |23] | holds then 
the time average energy satisfies the following, 

T— 1 

limsup;^5]E{.g(t)}<,g* + | (28) 

Theorem 5: ESS algorithm is energy optimal and satis- 
fies (|28]l. 

Proof: Rewriting ( |25] | and using (|26] | we attain, 

A(i) + yE(iJ(t)|Q(t)) <B -eY,Qn{t) (29) 

n 

+ vnHe{tm{t)) 

We take the expectation of both sides of (29) and obtain 

A(i) + V¥.{H{t)) < B - eE ( ^ Q„{t) j + V¥.{H,{t)) 

(30) 

Note that inequality ( l30l l holds for any time slot t. Hence, 
we sum both sides of (|30] | from time slot to T — 1 and 
divide by T. As a result, we obtain 



T 



T-1 



t=a n 



(31) 



Recall that in the previous section, we have shown that 
the second term in the RHS of dSTT i is bounded. By taking 
limsupT^^oQ, we get 

T — 1 

limsup ^ V VE(iJ(t)) <B + VE{HXt)) (32) 
Consequently, by dividing both sides of ( |32] i by V, we have 

T— 1 

limsupi^^E(if(i)) < §+E(7?,(t)) (33) 

Note that E{H^{t)) — !> ft,* as e — > as we have shown in the 
previous section. The bound in ( [33] l is clearly minimized by 
taking a limit as e ^> 0, which yields 



D. Distributed Implementation 

In this section, we present an approximate solution to the 
scheduling problem (6)-(7) that does not require a central- 
ized mechanism and thus it is easy to implement in a large- 
scale network. Recall that, the switching decision is made 
by a centralized authority with ESS algorithm. However, in 
a distributed way, each node can make a switching decision 
individually according to the followings rules: 1-) An active 
node n keeps staying in active mode as long as the following 
inequality holds, 

m(i)-e^(i)-e?o(<)) 



Qn{t) >- 



V?i e Ac (34) 



Therefore, in distributed implementation there may be more 
than one active nodes in the network at a given time slot. 
Note that, there should be only one active node at each 
time slot with ESS algorithm, and other nodes stay in sleep 
mode in order to reduce energy consumption. Thus, we 
expect that ESS outperforms the distributed algorithm in 
terms of lifetime. However, it is clear to see from (10) that 
ESS algorithm requires a centralized authority to make a 
switching decision since it requires the knowledge of the 
sleeping node which maximizes the left hand side of (10). 

2-) On the other hand, sleeping nodes remain in the sleep 
mode if the following inequality is satisfied, 

V{eT{t) + e^,{t)-e^{t)) 



Qmit) <- 



^J■mit) 



V?7i e 5"^ (35) 



Otherwise, they switches to active mode. After deter- 
mining the energy modes, scheduling decision is given 
among the active nodes. The knowledge of backlog levels 
in the neighboring nodes can be maintained by infrequent 
broadcasting. The minimum energy broadcasting method is 
proposed ET\ and it can be applied to our model in order 
to find the transmissions node. Afterwards, the node which 
maximizes ( [36] l is scheduled. A more formal representation 
of distributed implementation is given below as Algorithm 
1. 

max Qn{t)^lnit) - Ve^Jt) - Ve^it). (36) 

n£Ac 

VI. Numerical Results 

We consider a scenario where there are 5 sensor nodes 
and a base station. The nodes observe their surrounding 
and generate random packets and transmit them to the base 
station in a single-hop fashion. We assume that each node 
has a battery with an initial energy of 10 Joules. The arrival 
processes are assumed to be Bernoulli processes with an 
average rate of 4 packets with size of 45 bytes per slot for 
all nodes and without loss of generality we assume that a 
slot is 2 millisecond (ms) long. For a particular node, there 
are three equally likely possible channel states, i.e.. Good, 
Medium, Bad where the corresponding transmission rate of 
a node is assumed to be 20, 12, and 5 packets respectively. 
The parameters used in the simulation are given by ||2]. 



Algorithm 1: Distributed Algorithm 



1: Initialize: Set all nodes to the sleep mode and the remaining energy 
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13: 
14: 
15: 
16: 
17: 
18: 
19: 
20: 
21: 
22: 
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while Ei(t)> do 

generate packet arrivals and transmission rate 
me SI and Qdt) < y('=iW+'=oiW-eo(t)) j^^^, 

compute Bi(t)=Ei(t)-eo('t) 

compute weight{i) = — Veo(t) 

else iSi€Sl and Qi(t) > y(<=iM+<^oiM-^o(t)) ^^^^ 
add node i to Ac {switch to active mode} 

compute Ei(t)^Ei(t)-eQi(t)-c{t) 

compute weigh.t{i) = Qi{t)fj,(t)-V{eoi{t)+ei(t) + afi(t)) 

end if 

Hie Ac and QJt < v{^i{t)+a:^{t)-<,,o(t)-eo(t)) then 
add node i to Si {switch to sleep mode} 

compute Ei(t) = Ei(t)-eio(t)-eo(t) 
compute weight(i) = -V(eio(t) + eo(t)) 

else if i G Ac and Qi{t > v-(ei(t)+c.M(t)-eio(0-eo(t)) 
compute Ei(t)=Ei{t)-c(t) 

compute weigh.t{i) = Qi(t)ii{t)-V{c{t)+OLfj.{t)) 

end if 

if i £ Ac then 

compute Bi(t)=Bi{t)-e(,{t), {broadcast its weight} 
if i = argmaxj weight{j) j G Ac then 

-Bi(t) = -Bi(t)-a(t)fii{t) 

end if 
end if 

update Qi(t) 
t=t+i 
end while 



then 



• sleep mode energy, cq : Nodes consume energy in sleep 
mode and it is equal to 0.015 x 10^® J per millisecond. 

« active mode energy, e\: The nodes in active mode 
consume energy due to being in active mode, c(<) and 
also for the transmission of each packet, a(t). Thus, 
ei(i) = c(t) + fi{t)a(t). c(t) is given as 36 x IQ-^J 
per millisecond and a{t) is taken to be 30 x 10^^ J per 
packet transmission. 

• energy due to switching from sleep to active, eoi : 
Switching time from sleep to active is 0.7 ms and the 
switching energy from sleep to active is equal to 25.2 x 

• energy due to switching from active to sleep, eio : 
Switching time from active to sleep is 0.01 ms and 
the switching energy from active to sleep is equal to 
2.85 x 10"^ J. 

• Broadcast energy, ef,(i): Broadcast energy is taken to 
be 8.33 X 10"^/ per bit. 

If a sensor node is in sleep mode at the beginning of a time 
slot and wants to switch to active mode, then the switching 
takes 0.7 ms. Thus, the sensor can stay in active mode for a 
duration of 1.3 ms since total slot duration is 2 ms second. 
Additionally, it consumes a packet transmission energy if it 
is selected by ESS algorithm. As a result, it consumes an 
amount of energy which is equal to 1.3ms x c{t) + afi{t). 
When the node keeps it energy mode then, there will be no 
switching energy and the energy consumption will be equal 
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Figure 1. Avg. energy consumptions in active and sleep modes 



to only the sleep energy, eo(i). On the other hand, if an active 
sensor is selected to be the active node the next slot, then it 
can use entire slot for its own transmission since there will 
be no switching time and the energy consumption will be 
2ms X c{t) + afi{t). If it switches the sleep mode, the energy 
spent by the node will be equal to 1.99ms x eo{t) + eio 

First, we investigate the average energy consumption 
in sleep and active modes for V = 500, 1000, 5000, 
10000, 20000, 40000, 60000 and 80000. Figure □ depicts the 
average energy spent in active and sleep modes. As V grows, 
the nodes run out their batteries by staying in sleep mode 
most of the time. This prolongs their lifetime since they 
consume the minimum energy in sleep mode and this result 
agrees with Theorem 5. Due to the fact that the nodes 
can not transmit in sleep mode, it yields an increase in 
queue sizes of the nodes and consequently average delay 
in the network increases. Next, we conduct a simulation 
experiment to observe the bursty departure property of ESS 
algorithm explained in Lemma 1. As stated in Lemma 1, 
the nodes transmit their packets consecutively in order to 
reduce the switching energy. Figure |2] depicts the average 
number of bursty active staying which is the number of two 
or more consecutive time slots where the node is selected 
to be the active node and transmits. Higher values of V 
push the nodes spend the minimum energy and in order 
not to consume switching energy the nodes are selected 
as the active node in a bursty fashion. Furthermore, we 
compare the ESS algorithm with a "benchmark algorithm" 
and the S-MAC type algorithm proposed in ll22l , namely 
"periodic algorithm", in terms of the average queue backlogs 
for different values of V = 400,800,1200,1800,2500. 
Contrary to ESS, the benchmark algorithm ignores the 
switching energy and makes the switching and scheduling 
decisions without considering switching energy cost. There- 
fore, the nodes change their modes more frequently. In S- 
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Figure 2. Bursty transmission 



Figure 4. The network lifetime for different values of V 
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Figure 3. The average queue backlogs for different values of V 




Figure 5. Duty cycle 



MAC type periodic algorithm, the nodes stay in sleep mode 
during the fist 1 ms and during the last 1 ms, they stay 
in active mode. Furthermore, the node which maximizes 
Qn{t)Hn{t) — Vafinit) is Selected as the transmitting node 
during the active period. As it is seen in Figure |3] the 
benchmark algorithm outperforms ESS in terms of the queue 
backlogs, since it stays in the active mode at most of the 
time. On the other hand, since ESS promotes the nodes 
to stay in sleep mode considering the switching cost, it 
prolongs the network lifetime. The periodic algorithm has 
the worst performance since it has fixed duty cycle property 
which can not ensure the efficient time to reduce the queue 
backlogs as much as ESS algorithm. Figure |4] depicts the 
comparison of the lifetime performance induced by ESS, 
the benchmark, the distributed and the periodic algorithms. 
The distributed algorithm allows more than one nodes to be 
active at any time slot and the benchmark algorithm does 
not care the switching energy cost. In addition, the periodic 
algorithm forces the nodes to be active for 1 ms at every slot 
and due tot he fixed duty cycle, V does not effect the lifetime 



of periodic algorithm. Thus, with these algorithms, the nodes 
stays in active mode unnecessarily. As a result, batteries 
of the node run out quickly. Therefore, EES shows better 
performance result in terms of lifetime. Finally, Figure 2] 
depicts the average duty cycle of the network per node. As 
V increases, the proportion of time the nodes stay in active 
mode decreases to prevent the energy consumption. Thus, 
the average duty cycle period decreases as well. It is easy 
to see that the duty cycle per node can be approximately at 
most %13. As stated in f2\, the switching energy needs to 
be computed if the node duty cycle is low. Thus, the effect 
of switching energy becomes significant. 

VII. Conclusion 

In this paper, we investigate the energy efficiency and 
optimal control problems in a low duty cycle wireless 
sensor network. Using Lyapunov optimization technique, an 
energy-aware switching and scheduling (ESS) algorithm is 
proposed. The switching energy is generally not considered 
in energy management problems. However, analysis indicate 
that ESS algorithm outperforms the benchmark algorithm 



which ignores the switching energy cost in terms of the 
Hfetime. Furthermore, we show that we can stabiHze the net- 
work by applying ESS algorithm and push its performance 
to the optimal solution by tuning V parameter In addition, 
we present a distributed algorithm that can be implemented 
easily. 

In terms of future work, we investigate the power control 
problem. Shortly, the power control problem is explained 
as follows. If the sensor nodes have power control, there is 
an inherent trade-off between the transmission power and 
the time spent in active mode. Note that the transmission 
rate fin{t) = log ^1 + -^7^^, where P„(t) and N are the 
transmission and ambient noise powers respectively, is an in- 
creasing concave function. Therefore, as transmission power 
of node n increases, the number of bits sent increases and the 
backlog of the active node drops below the aforementioned 
threshold more quickly. 
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